Information retrieval evaluation using test collections
نویسندگان
چکیده
منابع مشابه
Boiling down information retrieval test collections
Constructing large-scale test collections is costly and timeconsuming, and a few relevance assessment methods have been proposed for constructing “minimal” information retrieval test collections that may still provide reliable experimental results. In contrast to building up such test collections, we take existing test collections constructed through the traditional pooling approach and empiric...
متن کاملBuilding Reliable Test and Training Collections in Information Retrieval
Research in Information Retrieval has significantly benefited from the availability of standard test collections and the use of these collections for comparative evaluation of the effectiveness of different retrieval system configurations in controlled laboratory experiments. In an attempt to design large and reliable test collections decisions regarding the assembly of the document corpus, the...
متن کاملInformation Retrieval Systems for Large Document Collections
Practical information retrieval systems must manage large volumes of data, often divided into several collections that may be held on separate machines. Techniques for locating matches to queries must therefore consider identiication of probable collections as well as identiication of documents that are probable answers. Furthermore , the large amounts of data involved motivates the use of comp...
متن کاملTest Collection Based Evaluation of Information Retrieval Systems
Use of test collections and evaluation measures to assess the effectiveness of information retrieval systems has its origins in work dating back to the early 1950s. Across the nearly 60 years since that work started, use of test collections is a de facto standard of evaluation. This monograph surveys the research conducted and explains the methods and measures devised for evaluation of retrieva...
متن کاملPerforming Informetric Analysis on Information Retrieval Test Collections: Preliminary Experiments in the Physics Domain
The combination of informetric analysis and information retrieval allows a twofold application. (1) While informetrics analysis is primarily used to gain insights into a scientific domain, it can be used to build recommendation or alternative ranking services. They are usually based on methods like co-occurrence or citation analyses. (2) Information retrieval and its decades-long tradition of r...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Information Retrieval Journal
سال: 2016
ISSN: 1386-4564,1573-7659
DOI: 10.1007/s10791-016-9281-7